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ABSTRACT 

The Onited States Training and Eaployaant Service 
General Aptitude Test Battery (GATB) , first published in 1947, ha^ 
been included in a continuing program of research to validate the 
tests against success in many different occupations. The GATB 
consists of 12 tests which aeasure nine aptitudes: General Learning 
Ability; Verbal Aptitude; Numerical Aptitude; Spatial Aptitude; Pora 
Perception; Clerical Perception; Motor Coordination; Finger 
Deiterity; and Manual Dexterity. The aptitude scores are standard 
scores with 100 as the average for the general working population, 
and a standard deviation of 20. Occupational noras are established in 
teras of Biniaua qualifying scores for each of the significant 
aptitude neasures which, when combined, predict job performance. 
Cutting scores are set only for those aptitudes which aid in 
predicting the performance of the job duties of the experimental 
sample. The GATB norms described are appropriate only for jobs with 
content similar to that shown in the job description presented in 
this report. A description of the validation sample is also included. 
<RC5 
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D»»velopne?nt of USES Specific Aptitude Tost Battery S-52nR7ft 



For 



Clerk, General Office (clerical) 210.380 



RESEARCH SUMMARY 



This report describes the research v/hich resulted in the develop 
nent of the following Specific Aptiturte Test Battery for use In 
selecting inexperienced or untrained Individuals for tralninc as 
General Office Clerks: 



Antt tudos Cvn.tinr. gCQrg? 

G - cJcneral Learnlnj^ Ability TO 
n - numerical Aptitude 

Q - Clerical Perception 110 



Validation sanple: h07 General Office Clerfrs (3^8 fenates and 10 
males) fron the Morth, South and West (see Appendix 2). A total 
of 1:52 were minority Rroup nenbers (130 Blacks, 27 Spanish Surnaned, 
18 After ican Indians, 3 Orientals and U French Canadians) and 22? 
were nonnlnority i;roup nie'nbers. 

Cross-validation sanple ^1: 103 General Office Clerf-.s O'f fenales 
and M males) fron the North (see Appendix 2). This study was 
co'-dticte<i prior to the requlrp-^cnt of providing minority group 
infornation. Therefore, ninor'ty croup status of sample ne-nbers 
is unknown. 

Cross-validation sample ^2: 89 MDTA General Office Clerk trainees 
(8fi renales and 1 male) fron the Morth (see Appendix 2). A total 
of 5 were ninorlty i;roup ne-nbers (k Blacks and 1 Oriental) ani 
were nonnlnority f;roup tne'nbers. 



Vali'lation sanple: Supervisory ratings. Criterion data v/ero 
collected durlnr. 1972, 1073 and 107J!. 

Cross-validation sanple «*1: Supervisory ratings. Criterion data 
were collected during 1058 and lOCl. 

Cross-validation sanple #2: flultlple hurdle of broad category 
supervisory ratings and combined speeti and error typing scores. 
Criterion data were collected during lOfiS and 1300. 
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ValMiation satnple: Concurrent (test anci criterion data \tere 
collticted at about the same time). 

Cross-validation sanple Concurrent. 

Cross-validation sanple «*2: Lon^^i tudi nal (tests were adninistered 
at tlie besinnins of the MDTA training course; criterion data v/ere 
obtained six months later after completion of the traininp.). 

Validitvt 

Val hfation Sample: 

Phi coefficient for total sample = .51 (P/2 < .0005) 

Phi coeff'cient for Black suhsample «.20 (P/: < .0005) 

Phi coefficient for nonrninority subsample = .2^ (P/2 < .0<^nS) 

Cross-validation sample f'l: 

Phi coefficient for total sample » .2^1 (P/2 < .01) 
Cross-validation sample *2: 

Phi coefficient for total sample « ,kl (P/2 < .0005) 

Effectiveness, .pf ....P^ttery fQ.r., yaijcitU'Qn S.anpie.; 

For the total validation sample, 65?^ of the sample were in the hl,';h 
criterion group; If they had been test-selected with this battery, 
7B'^i uould have been in the hiah criterion group; SSf; of the sample 
were in the low criterion group; If they had been test-selected 
with this battery, 22^^ would have been In the low criterion .r;roup. 
The t?f f ect i veness of the battery is shown in Ta!>le 1. 

TABLE 1 

Effectiveness of Battery for Validation Sample 

Ult:hout Tests .11 th Test^ 

HlHh Criterion 65"; 7'?'^; 

Group 

Low Criterion 35rj 22r; 

Group 
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Como.ir t son c;f iit ttoritv c^n,! 'jorvMnorttv ur olios t 
No different iol valtdlty for ttiis bcittery v/as foiinfi. The dif- 
ferencfc beti'oen the phi cocf f i c i <jnts for lilaci; an 1 notini nor t ty 
suhf,roups of ihii vdlMiatton Ssii'>ple is not utat I st i call y signifi- 
cant (CP - .O'i). Tho battery is f.ilr to Ll.icks since the propor- 
tion of Blacks uho it't the cuttinr. scuros noprox t nnto.! tho pro- 
portion v/ho v/ere in the h 5 .;h criterion ,;roijr>. 37^ of the lilacl<r, 
met the cutting 5Cv)ros and were in ti^e in r.h critorion t;roup. 



A job analysis was performed by observation of the workers* per- 
fomunnce on the Job ani* In consultation u\th the v/orkors' super- 
visors. On the basis of tne job analysis, the job description 
shown in Appenfix U v.'as prepared, which v.-as used to (1) select 
an oxj>er i nctntal sanple of individuals v/ho v/ore performins or i>eing 
traifjed for thi? job; (2) choose an appropriate criterion or measure 
of job f)er fornance; (3) determine which aptitudes are critical, 
important or irrelevant to job performance (see Tables 2 and D); 
and iU) provide infornation on the appl icabi li t y of the test battery 
result inj^l fron this research. 



JOB ANALYSIS 



TABLE 2 



Uualitative Analysis 



Rationale 



G - (ieneral Learn I nj; Ability 



Required In understanding oral and 
written instructions and in learn- 
ing and perforn^lng the various duties 
of the job. 



V - Verbal Aptitude 



i^equi red in understanding the mean- 
ing and relationship of v/ords and 
sentences. 



U - ilumericdl Aptitucie 



Required in per forninp. computa- 
tional duties. 



Q - Clerical Perception 



Required in checking work for 
errors. In reading and recording 
numbers and nanes, in filing 
letters. In preparing records ?nd 
reports, ami in posting data. 



K 



- f*iOtor Coordination 



Required In filing and sorting and 
In performing various office ma- 
chine operations. 



F - Finger Oexterlty 



Required in operating office ma- 
chinery such as typev/rlter, calcu- 
lator and adding riachlnes. 



- u - 



LXPERIfltNTAL TCST BATTEI^Y 
All 1? tests tho GATB, B-10a2B. 



At] 12 test*; of the GATR, B-1002A. 

Cross"vn! i c<ni: t on Sannle 

All 12 tests of the GATB, B-i002B. 

The r )(rie«! i ate supervisor rated each worker. The rntinr,s v/ere 
otftained '>y nonns of personal visits of State tost rievolnpnont 
analysts v.ho explained the rating procedure to the superv » sor «; , 
Two ratings v/ore ol>tai ned fron each supervisor v/!th an interval 
of t\.'o \/ce'.s botv/een the ratings. Since sanple nomhors* test 
scor<^s are confidential, supervisors had no knoi/ledse of the 
test scores of tho v/orkers. 

A descriptive ratinf; scale was u'>ed. The scale (see Appendix 5) 
consists of six perfornance items. Pive of these items cover dif- 
ferent asoects of job per fort^ance. The sixth 1 ten is a ,;loba1 
iteii on tho General Office Clorl-s*5 "all-around" ability. Each 
i te.i has five alternative responses correspond! nj; to different 
degrees of job proficiency. For the purpose of scoring, tho i tcnS/ 
weights of 1 to 5 v/ere ossl/^nod to the responses. Tf>e total score 
on the rati nr. scale is the sun of tho v^eir.hts for the si;: I tens. 
The possible ran;;e is C-30. 

A review of the job description indicated that the subjects covered 
by the rating scale v/ero directly related to inoortant aspects of 
job perfornance. 

A - /Vtiotjnt of v/ork: ./ork nust be perforncd at a satisfactory pace 
to avoid backlon of projects. 

B - Quality of work: Letters, bills, statenonts and other nate- 
rials nuGt be neat and legible in order to be acceptable. 

C - Accuracy of work: Conputat ions, fillnr;* postinr./ etc., inust 
l>e accurate in order to be acceptable. 
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D - Amount of knowledge: General Office Clerk nust have knowledge 
of nrannar^ arlthnetic and office machine operation In order to 
i>erfr>rn the job duties satisfactorily* 

E - ^'arlety of job duties;: General Office Clerk should be able to 
handle a lar^e variety of tasks without specific Instruction. 

F - "All-around" ability: General Office Clerk's value to enployer 
Involves a combination of the aspects ^f job perfornance listed 
above 4 

A reliability coefficient cf . 8f> v/as obtained betv/een the Initial 
ratings an! the re-ratinr,s, Indlcatinn a significant relationship. 
The final criterion score consists of the combined scores of the 
t\/o ratlnf.s. The possible range Is 12-rO. The mean score on the 
final criterion was with a standard deviation of 7.8.^ The 

relationship between the criterion and a^e^ education and job ex- 
perience Is shov/n In Table 3. 

TABLE 3 

Val Mat I on S.inple 

fteans. Standard Deviations (SD) and Pearson 
Pi oduct -Motion t Correlations v/lth the Criterion (r) for 
Arte, Education and Experience 

Mean ^ L 

Ane (years) 2C.U ^^.H .I2h* 

Education (years) 13. U 1.1 .017* 

Experience (.months 29. 7 38. 0 .237** 
on current job) 

♦Significant at the .05 level 
•♦*5h;ni f I cant at the .01 level 

About one-third of the v/orkers are consMered to be narglnal work- 
ers. Therefore, the criterion distribution was dlchotonlzed so as 
to Include about one-third of the sample In the low criterion group 
and the rerrtaln-ler In the high criterion fjroup. The criterion cut- 
ting score v/as set at 39 which places 35?; In the low criterion 
group and CSr; In the high criterion group. 



One i»ertor uincc r^jtinr. '..os o!)toinci trn:\ tho \ :v\o'\\ titc stiporvl sor 
of e.ich './orfxor. uince sa. iple ii?'il)ors' test -icores arc con^" i r*ent i ^ 
supervisors : no Knm. 1 o.i.;L» of the test ucorcs of the worker?;. 

A de-.cr i ;>t i ve rotln>; r>c.ile uso^!. Tne ucalo (see Apnen^llx 5) 

Cinsiitb of nltie Ite is, Kl -ht of ttu^bo Itens cover tiifforent a-j- 
pectr, of job Dcrfori-vmce . Tmp ninth i to* » is a •;1ol>n1 i te.M on the 
uencr^jl Offici> Cler!.*'^ "nll-arounH" .if>il{ty. L.ich ite'i ha^i five 
alternative re';ponso«; cor respon i i np, to viifferent fle^.reos of job 
;>rof i c I ency. Fur the purpose of scortn.-; the itOMs, wti*,hts of 1 
to 5 wert^ .ibsi^'.nec' to the t^'fiponses. Tne total score on the rot ins 
sctile i ih?> sw of the weij'.hts for the nine i tens. 

A revie\/ of the job uescriptlon indicate? th.it the subjects coverel 
by the r»itin;'. scole .^erc lirectly related to i.iportant aspects of 
j<»b per f orn.ince , 

A - Anount of v/ork: ./ork .lust t>e fjerfornc'l at a satisfactory pace 
to avoid a b.icklo,; of projects. 

B - Quality of work: Letters, bilt-i, statements an< other lijaterials 
nust be neat an.i 1e;'Jb1e in orc^or to be acceptable. 

C - Accuracy of v/ork: Computations, fi lln.-;, postinU/ etc., must 
be accurate in orHer to be acceptable. 

D - !Cnow]ot{,^e of job: Cieneral Office Clerk .>ust have specific 
l;nov;i e'?.';e of office procecfures an-l lachinos. 

E - Pacility for .,'ork: General Office Clerk should !>e able to 

apoly knov;leif*e of principles ani procedures to specific situ- 
ations in orvier to pro«^uce satisfactory v/ork, 

F - *'arlety of job duties: General Office Clerk nust be able to 
handle a larr.e variety of tasks without specific instruction. 

G - Resourcefulness: General Office Clerk should be at>le to apply 
I;m>v7ledr,e to new situations and act accordingly. 

H - .SuRKOSt ions for inprovonent: General Office Clork should be 
able to notice "vays to improve office procedures. 

I - "All-around" ability: General Office Clerk*s value to th** 

employer involves a conbf nation of the aspects of jo!> perforn- 
arica I i stCvi above. 

Since only one rating v/as obtaineJ, the estlnatei reliability of 
the criterion v/as leterni ne^i by obtaining: the relationship between 
the total -Rescript ive rating scale scores and the ratln.-; on ite". I 
("All-around" ability) of the i»cale. a reliability coefficient of 
,11 ./as obtainel. Tt:c possible ranr.e for the final criterion is 
''f-JjS. The actual ran/,e is 17-(;r. ..'i th a lean of 52.2 anJ a standard 
deviation of f;.3. Tne rel at i onshl between the criterion an^ ar,e, 
gl^^cntion art'- job experience is shov/ij In Table 5a. 
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TABIC 3n 

Cross-validation Sanple ^'1 

.'teans^ Stanlar*' Deviations <SD) anH Poarson 
Proc^uct-Monent Correlations with the Crltorfon (r) for 
Ai'^e^ LJucotlon and txperlenco 

Ane (years) 2). 7 10.5 .f»25** 

EJucation (years) 12.^ . *: .008 
experience (nonths) Gl.l* 7U.5 »ViU** 

**SI,;ni f leant at the .01 level 

About one-third of the worlcers are considered to be narrJnal 
worlcorti. Tnercfore the criterion .distribution was dl chotonl zeM 
so a'l to include about one-third of the sample In the lov/ criterion 
group and the renainder In the high criterion f;roup. The criterion 
cuttlnR score ./as set at 50 which places 37'i in the low criterion 
r,rouP ant! 03"; in the hi^jh criterion group. 

Two criterion .jeasures were obtained; one consisted of broad cate- 
fiory instructor ratings and the other consisted of combined speed 
an«^ orror typing, test scores. 

Each instructor was asked to place the class In a rank order by 
overall classroom perfornance. The Instructor then divided this 
rank order Into five broad catefforles as follows: not acceptable, 
somewhat Inferior, generally acceptable, usually superior, and 
ali.iost always top notch. This allowed data from the different 
Instructors to be conblned. Trainees who v/ere placed In the "below 
average" iiroups were considered to be In the lov/ criterion ^roup. 
28.; of the sanple was considered "below average". 

The second criterion v^as words-per-nl nute adjusted for errors on 
the USES typing test administered during the final nonth of train- 
ing. Discussions with Enployment Service local office personnel 
Indicated that 35 words-per-ml nute v/as required of an applicant to 
afford a reasonable expectation of beln;; hired after referral. 
Thus, 55 words-per-mlnute was set as the cutting score for this 
criterion i^easure. This placed U35 of the sample In the low crl* 
terlon group. 



ERIC 



.0 



- 8 - 



A correlation coefficient of .72 v^as obtained betv/een the tv/o 
criterion measures. A niul t i pte-hurdl e technique wns used. Tne 
trainees ha-.l to l>e in the hi/;h criterion group on each criterion 
in order to bo place.! in the finai hiuh criterion p»roup. 51", of 
the r.ample wns placed in the hi^h criterion proup. The relation- 
ship between the criterion measures and ar.e and edtication Is shown 
in Table 3b. 

TABLE 5b 

Cross-validation Sample *2 

Heans, Standard Deviations (SD) and Pearson Product- 
rioment Correlations vn th Criteria 1 (r,) and 2 (r^) 

for Age and Edt»cation 

Idaaa in j:^ 

Aiie (years) 20.3 11.2 .OUC -.152 

Education (years) 11.5 1.2 .261* .198 

•Significant at the .CD level 

■♦♦Corrected for criterion variable expressed in i)road 
categories 

SAflPLE 

Validation Sa;nolfii 

The validation sa^iple consisted of J*07 General Office Clerks (5^3 
fenales and 1) ..lales) e.iployeri at various companies in the Worthy 
South and West (see Appendix 2). ^ total of 182 were nlnorlty 
group .lenjbers (150 Blacks^ 27 Spanish Surnamed, IS Anerlcan Indians, 
3 Orientals and i* French Canadians) and 225 ./ere nonmlnority fsroup 
me*nbf»rs. The neans and standard deviations for age, education and 
experience of validation sa.nple members are shown In Table 5. Sone 
eviployers used proficiency tests for selection but no aptitude 
tests vvere used. All i/orkers had at least tv\x> months total job 
experience in jobs ivhose duties are sinMar to those found fn the 
job description in Appendix k. Descriptive statistics for sub- 
groups are shov/n In Appendix 1. 
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Cros'j-val idation Sanple ^ . 

The cross-validation sanple n consisted o*" 10> General Office 
Clerl'.s i )k fe.ialeb end 0 males) e-mloyed by various companies in 
the Morth (see Appen.lix 2). This study was conducted orlor to 
the requi ro'Mont of proviJin/* r.iinority nroup information on satiplc 
le-rjbers; therefore, .minority ^roup infornatlon Is not kno\.'n. 'io 
sa-nple nenbers were test-selected. Tne leans and stanlard devla- 
tionr. for a^e, education and experience of sample -ne-ibers are shov/n 
In Table 3a. All workers had at least 5 nonths total job experience 
In jt>bs v/lth ^uties similar to those sho\/n in th'e job description 
•n Appenfli X 

Cross-val idation Sample 

Tne cross-validation sample *2 consisted of ftDTA General Office 
ClerU trainees CHS fe.nales and 1 ;iale) enrolled at various training 
facilities In the 'lorth (see Appendix 2), A total of five 
were -.ilnority nroup r.iembers (•'* Blacks sn'l one Oriental) and were 
nonmlnority ^roup me:.ibers. Means and standard deviations for age 
and education of saniple nenbers are shown in Table 3b. rio sanple 
;'.e«.ibers were test-selected. All sample .lenibers i/ere receiving 
training In preparation for jobs v/lth flutles similar to those shown 
in Appendix it. 

STATISTICAL :^ESULT;i 
TABLE U 

Statistical Results for Validation Sanple 













G 


- General Learning Ability 


100.2 


Ih, 


f) 


.358** 


V 


- Verbal Aptitude 


102. 2 


13. 


ij 


.510** 


tl 


- (iumerlcal Aptitude 


102.2 


16. 


0 


.3U«t** 


S 


- Spatial Aptltur'e 


09.9 


IC. 


B 


.15:)** 


P 


- Form Perception 


IIG. U 


13. 


h 


.22^*** 




- Clerical Perception 




17. 


0 


.2U7** 


K 


- r*otor Coordination 


115.5 


17. 


5 


.155** 


F 


- Finger Dexterity 


102.7 


21. 


k 


.12^** 


n 


- fianual Dexterity 


101.0 


23. 




.18G** 


*« 


' Significant at the .01 level 
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Tablo 5 uunr.iar Ues the qualitative analysis anri statistical results 
shown In Tables 2 and k and shows the aptitudes consl*iered for In- 
clusion In the battery, 

TABLE n 

Sannuiry of viualltatlve ana Quantitative D^ta for Validation Sanple 



Apt I tudes 



Type of Evidence 


(i 


V 


N 


S 


p 


Q 


K 


F 


M 


"Critical" on Basis 
of Job Analysis 


•M iportant" on Basis 
of Job Anal ysi s 




X 


A 






X 


X 


X 




"Irrelevant" on Basis 
of Job Analysis 


Relatively iii^ih 
Mean 










X 


X 


X 






Relatively Low Standard 
Devi at Ion 


X 


X 
















Sff;nificant Correlation 
wl th CrI terion 


X 


X 


X 


X 


X 


X 


X 


X 


X 


Aptitudes Considered for 
{ncliislon in the Battery 


u 


V 




s 


p 


Q 


K 


F 





The Information In Table 5 Indicates that the follov/Ing aptitudes 
should be considered for inclusion in the battery: G, U, $, P, 

F and f1. The objective Is to develop a battery of 2, 3 or U 
aptitudes with cutting scores set at five point Intervals at the 
point (a) v/here about the same percent will neet the cutting 
scores as the percent placed in the high criterion group and 
(b) v/hich will Maximize the relationship betv»?een the battery and 
the criterion. The cutting scores are set at approximately one 
stanilard deviation oelov/ the -nean aptitude scores of the sanple, 
with deviations above or below these points to achieve the objec- 
tives indicated above. 

The following battery resulted: 

Apt! t«<jes PMttIng $<:gres 

6 - (Jeneral Learning Ability ^0 
ti - Mumerlcal Aptitude 95 
Q - Clerical Perception ^ , 110 

^ 1.3 
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VALIDITY OF THE BATTERY 
TABLE G 

Validity of Battery for Total VaUdatl^.rt Sample 

Below Meeting 

Piitslnff ggtfres QMtt:»nR gcor^s latal 

High Criterion 90 17k 26i» 

Group 

Low Criterion 05 U8 lk> 

Group 

Total 185 222 h07 

Phi coefficient « .31 
Significance level » P/2 < .0005 

TABLE 6a 

Validity of Battery for Black Validation Subsample 

below Meeting 
Cutting Scores .Q.MSt!nR '^^COrQS 19X^1 

High Criterion 30 32 52 

Group 

Low Criterion 52 16 63 

Group 

Total 82 US 130 

Phi coefficient. « .23 
Significance level « P/2 < .0005 

TABLE Gh 

Validity of Battery for Nontnlnorlty Validation Subsanple 

Below Meeting 
Cutting Scores C^tt'nfi ?CPrQg Ip.tal, 

Hl;?h Criterion '4'4 123 1C7 

Group 

Low Criterion 35 2D 5 J 

Group 

Total 77 lf*C 225 

Phi coefficient = .23 

Sii;nlf Icance level « P/2 < . 0005 



14 



- 12 - 



TABLE 7 

Validity of Battery for Cross-validation Sample ^1 

Below Meeting 

Cutting sgprgs CM.ttj.nf>, gcprgs Tqt^l 

High Criterion 23 k2 55 

Group 

Low Criterion 25 15 38 

Group 

Total 1*6 57 103 

Phi coefficient « . 2^* 
Significance level = P/2 < .01 

TABLE R 

Validity of iJa*:tery for Cross-validation Sample 

Below Heetlng 
Cutting Scores ,P,Mttinfi gCQrPS I&Xal 

High Criterion 7 38 k5 

Group 

Low Criterion ?.k 20 kk 

Group 

Total 31 58 89 

Phi coefficient = .kl 

Si«jnif Icance level « P/2 < .0005 

OCCUPATIONAL APTITUDE PATTERN 

This occupation v/as Incorporated Into 0AP~17 In Section II of the 
1970 edition of the Manual for the USES General Aptitude Test 
Ba |;tGrv as a "double asterisk" i**), because Aptitude V is not con- 
tained in the battery but a significant phi coefficient was obtained 
between the criterion and the OAP-17 norms of Q-IO, V-00 ani Q-100. 
A phi coefficient of .20 (P/2 < .0005) was obtained for the Valida- 
tion sample data. The Cross-validation Sample «'l phi coefficient 
was .28 (P/2 < .005); Cross-validation Sample #2 phi coefficient 
was .15 (P/2 < .10). 
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APPENDIX 1 



Descriptive Statistics for Black and 'Jonnfnority Sub^^roups 

of Validation Sanple 

Black Monnfnorlty 
(.i«130) (N«225) 



Variable 










iD 






AptttuJe G 


02.5 


12. U 


EJ8-150 


105.3 


Ik, 


1 


70-138 


Aptitutie V 


or.. 3 


11.3 


7U-150 


lOC.l 


13. 


h 


7U-1U7 


Aptitude N 


Sb. 1 




58-158 


lOf). G 


15. 


h 


Ok'lkC 


Aptitutie S 


95.3 




65-155 


102.0 


17. 


0 


G5-1U3 


Aptitude P 


111.3 


Id. 5 


G5-l{.5 


110.5 


19. 


8 


G0-1G7 


Aptitude U 


122. y 


ir.r> 


90-17G 


12G.U 


17. 




80-100 


Aptitude K 


117.3 


IC. 1 


&C-150 


ll.'f.:l 


ir. 


n 


70-155 


Aptitude F 


«)0. 7 


10.1 




103.5 


iL £, • 


0 


37-161 


Aptitude it 


09.0 


22. 


52-lGn 


.01.0 


23. 


2 


If;-1F.7 


Cr 1 tor i on 


38. h 


7.3 


12-r;0 


U5.a 


7. 


1 


18-ro 


Afxe 


25.7 


0.1 


18-5U 


27.7 


11. 


5 


13-C.3 


Educ.it 1 on 


12. U 


1.0 


10-lG 


12. U 


1. 


1 


0-17 


tixperl ence 


23.2 


19.3 


1-00 


33. F 


Ul. 


r 


1-2U0 


(•lonths on 
















current job) 
















Total 


20. U 


2fuS 


2-127 


55.0 


00. 


2 


2-U20 



Exper i ence 
(months) 



Geor.raphic Distribution of Validation Sat\p1e 





Bl ack 
Subsamole 


1 Ota 1 
Sano\e 


:4orth 


kl 


135 


South 


75 


172 


v\*est 


in 


mo 


Total 


13 0 


U07 




Or<^»ani2atlons Contributing Samples for Validation Study 

Conhined Insurance Company^ Chicago, Illinois 

Granite City Steel Company, Granite City, Illinois 

Detroit hutual Insurance Company, Plymouth, hichisan 

Insurance Conpany of .^orth Arierlca, Detroit, Michigan 

Unlvorslty of Michigan, Ann Arbor, Michigan 

Wayne State University, Detroit, Michigan 

The :5t. Paul Insurance Companies, St. Paul, Minnesota 

American Optical Corporation, Kansas City, lilssouri 

Overland Associated Mortgage Conpany, Kansas City, Missouri 

Blue Cross of Eastern Ohio, Inc., Youngstown, Oh lo 

Legal Aid Society of Cleveland, Cleveland, Onio 

New York Life Insurance Company, Philadelphia, Pennsylvania 

Bryant College, Snithfield, Rhode Island 

Providence College, Providence, Rhode Island 

Roger Williams College, Bristol, Rhode Island 

Al 1 i s-Chalifiers, Mllv/aukee, V/i scons in 

Harni shf leger Corp., Milwaukee, v;i scons in 

Joseph Schlitz Brewing Company, Milwaukee, w'i scons in 

L. M. Berry Company, r-silwaukee, V^i scons in 

Menominee County, Keshena, Wisconsin 

Milwaukee YWCA, Milwaukee, Wisconsin 

Prudential Insurance Company, JacksonviPe, Florida 
Department of Economic Security, Frankfort, Kentucky 
Sears Town, Monroe, Louisiana 

American Airl ines, Tulsa, Oklahoma u t,, t 

National Life and Accident Insurance, Uoshville, Tennessee 
Texas Tech University, Lubbock, Texas . 
Colunbia Gas Company of West Virginia, Wheeling, .^est Virginia 
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McJunkfn Supply Company, Charleston, West Virginia 
Morris Plan Bank, Viheelfng, West Virginia 

V/est Virginia Department of Highways/ Charleston, West Virginia 
Viheelins Dollar Bank, Uhoelins, West Vlr,-»lnla 
Wheeling Pittsburgh Steel, Uheellnft, V^est Virginia 

West 

Alaska iiatlve Health Aroa Hospital, Anchorage, Alaska 
Apache Powder Company, Benson, Arizona 

Metropolitan Water District of Southern California, Los Angeles, 

Cal I f orni a 
City of Aurora, Aurora, Colorado 
City of Longnont, Longmont, Colora«1o 
Southv/est Gas Corp., Las Vegas, Neva'ia 
Portland General Electric CoRpany, Portland, Oregon 
State of Oregon Public i/elfare Division, various cities In Oregon 



Organizations Contributing Samples for Cross-validation Sample 

C. A, Reed Cotnpany, v/l 1 li anspor t, Pennsylvania 

Snellenberg A Company, Philadelphia, Pennsylvania 
Planters *Jut A Cnocolate Company, Ul I kes-Sarre, Pennsylvania 
Sylvania Electric Company, Wi 1 1 1 amsport, Pennsylvania 
Teleflex Incorporated, North Wales, Pennsylvania 

OrganUations Contributing Saciples for Cross-validation Sample ^7. 

Albert Lea Public Schools, Albert Lea, Minnesota 

Duluth Vocat ional -Technical School, Dultith, ninnesota 

Globe Business School, St. Paul, ninnesota 

Jackson Vocat lonal -Techni cal School, Jackson, Minnesota 

rilnneapol 1 s Vocat lonal -Technical School, hlnneapol I s, Minnesota 

St. Cloud Vocational -Technical School, St. Cloud, f'.innesota 

Winona Vocat lonal -Technical School, VHnona, fllnnesota 
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DESCRIPTIVE RATING SCALE 



SCORE 



PATING SCALE FOR 



O.O.T. Title and Code 



Directions: Please read the "Suggestions ti» Raters" and then fill in the items which lotlow. In making your 
ratings, only one box should be checked for each question. 

SUGGKSTIONS TO RATERS 

We are asking vou to rate the job performance of the people who work for you. These ratings will serve as 
a "yardstick' against which we can compare the test scores in this study. The ratings must give a true picture 
of each worker or this study will have very little value. You should try to give the most accurate ratings 
possible for each worker. 

Tliestf ratings are strictly confidential and won't affect your workers in any way. Neither the ratmgs nor 
test scores of any workers will be shown to anybody in your company. We are interested only m "testmg 
the tests " Ratings are needed only for those workers who ate in the test study. 

Workers who have not con^pleted their training period, or who have not been on the job or under your 
supervision long enougli for you to know how well they can perform this work should not be rated. 
Please inform the test technician about this if you are asked to rate any such workers. 

Complete the last question onl^ if the worker is no longer on the job. 

In making ratings, don't let general impressions or some outstanding trait affect your judgment. Try to 
forget your personal feelings about the worker. Rate only on the work performed. Here are some more 
points which might help you: 

1. Please read all directions and the rating scale thoroughly before rating. 

2. For each question compare your workers with 'Vorkers-in-general'* in this job. That is. compare your 
workers with other workers on this job that you have known. This is very important m small plants 
where there are only a few workers. We want the ratings to be based on the same standard in all the plants. 

3 A suggested method is to rate all workers on one question at a time. The questions ask about different 
abilities of the workers. A wi>rker may be good in one ability and poor in another: for example, a very 
slow worker may be accurate. So rate all workers on the first question, then rate all workers on the second 
question, and so on. 

4 Practice and experience usually improve a worker's skill. However, one worker with six months* experience 
may be a better worker than another with six years' experience. Don't rate one worker as poorer than 
another merely because of a lesser amount of experience. 

5 Rate the workers according to the work they have done over a period of several weeks or months. Don't 
rate just on the basis of one "good" day, or one "bad " day or some single incident. Think in terms of 
each worker's usual or typical performance. 

6 Rate only the abilities listed on the rating she^t. Do not let factors such as cooperativeness, ability to 

get along with others, piomptness and honesty influence your ratings. Although these aspects of a worker 
are important, they are of no value for this study as a "yardstick" against which to compare aptitude 
test scores. 
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sex MALE 



FEMALt 



Compunv Ji»h Iitic 



Haw ottcii do \ini see ihis worker 
in li work siliutii>n'* 

□ All the time 

Q Several times a Jjv 

tZ] Several times a week. 

iJ Seldont. 



Ht>w long have yi>u worked with this worker? 

□ Under one month, 
n One to two months* 
G Three to five months, 
n Six months or more. 



A Hi>w tniiwh wart this v^iirkcr get dime'' (Worker^ abiht^ ti> nuke efficient use of thne and to work at high speed.) 
(It It IS pt.NMhk- r.t iaU' nnly tfie quantitv i»f work which a person can do on this job as adequate or inadequate* 
uw f^Z to indicate "ifiadcijuate" and ^ to indicate "adequate.") 

CJ I Capable of vcrv low work output Can pefforni imly at an unsattsfactory pace. 

Cj 2. Capable i»f li>w uork 4»utpur. Can perfoim at a slow pace. 

iZI C.ipable of taif w-ntk output. Can perli»rin at an acceptable pa^e. 

lH 4. Capable t»t higfi work tnitput. Can perform at a fast pace. 

lI! 5 Capable of ver\ hipfi work mitpui. Can perform at an unusually fast pace. 

B. How giH»d IS the qualitv of wi>rk? {Worker's ability to do high-grade work which meets quality standards.) 

rn I. Performance infeni»r and almost never nuets minimum quality standards. 

Cj 2. Pertnrmance is usuall> acceptable but somewhat inferior in quality. 

D .V Performance is acceptable but usualU not .superior in quality. 

Cj 4. Perfttrmance is usualK superior in quaiitx . 

D 5. Perfi>rmance is almost always the higliest quality. 

C. How accurate is the work? (Worker's abilit> to avoid making mistakes.) 

□ 1. Makes very man> mistakes. Work needs constant checking 

[□ 2. Makes frequent mistakes. Work needs more checking than is desirable. 

□ Makes mistakes occasionally. Work needs only normal checking. 

□ 4. Makes few mistakes. Work seldom needs checking. 

O 5. Rarely makes a mistake. Work almost never needs checking. 
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fix llc»\% imivh diH»s the Wiukci know about the \ob* «Wotkct s imJctstaiiding i>t the ptinciplcs, equipment, matcriuis 
liixd nu'tlitilN that have to do diicctU ui inditectlv wtih the \vork.> 



LJ t. Has vcrv hmited knowledge IX^es know emmgh to do the job adequately. 

1^ 2 Has httlc knowledge Knows enough ti> get bv. 

L I 3 Has moderate atnount o\ knowledjxe. Knows etioujlli to do tair work. 

.n 4. Has broad knimledge. Kni^ws enough to do good work. 

i3 5. Has complete k!U>wlcdpe. Ktiows the job lhotoui»ld\. 
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v.. How large a vaneiv of jijb duties can the worker perfmin efficientU? (Worker's ability to hai^dle several different 
i»pcratti»ns.) 

lJ I . Cant^ot perform ditferent i>peralu>ns adequately. 

: 3 2. Can perform a limited number of different operations efficiently. 

IZ\ 3. Can perftmn several different operations with reasonable efficiencv . 

[71 4 ( an jx'rftvrm manv different opcratu»ns efficiently. 

13 5 Can perform an unusuallv large vaneiv of different ojxnaiions efficiently. 

I-. Cuosidcrmg all the factors alreadv rated, and iuily these factors, how giH)d is this worker? (Worker's all-around 
abilitv to do the job.> 

"TD 1 . Performance usually not acceptable. 
CI 2 Performance somewhat inferior. 
lJ 3. a fairlv proficient worker. 

□ 4. Performance usually superior. 
ZD 5. An unusually competent worker. 

Onnplete the fi>now!ng ONLV if the worker is no longer on the job. 

G. What do you think is the reason this persim left the job? (It is not necessary to show the official reason if you 
feel that there is another reason, as this form will not be shown to anybody in the company.) 

1. Fired because of inability to do the job. 

□ 2. Ouit. and I feel that it was because o^ difficulty doing the job. 

□ 3. Fired or laid off for reasmis other than ability to do the job (i.e., absenteeism^ reduction in force). 

□ 4. Quit, and f feel the reason for quitting was not related io ability to do the job. 

n S. Quit or was promoted or r<*assigned because the worker had learned the job well and wanted to advance. 
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sr(S<;KSTK)NS TO KATKRS 

\\V are tiskiiij; you to rate the job performance of the people who work for you. These ratings 
will serve as a "yardsliik'' against which w#> can lonipare the test Hcores in this study. The rat- 
ings fuust Kive a true picture of each worker or this study will have very little value. You 
should try to give the most accurate ratings possihic for each worker. 

These ratings are strictly confdential and won*t affect yow workers in any way* Neither the 
ratings nor ivM scores of any worker will be shown to anybody in your company. We are inter- 
ested only in "testing the tests/* Ratings are needed^ only for those workers who are in the 
test study. 

Wtirkcrs who have not completed their training period, or who have not been on the job or under 
your supervision long enough for you to know how well they can perform this work should not be 
rated. Please inform the test technician about this if you are asked to rate any such workers. 

In making ratings, don't let general impressions or some outstanding trait affect your judgment. 
Try to forget your personal feelings about the worker. Rate him only on the way he does his 
work. Here are some more points which might help you: 

1. Please read all directions and the rating scale tkorougMy before rating. 

2. For each question compare jour workers with "workers-in-general" in this job. That is, com- 
pare your workers with other workers on this job that you have known. This is very important 
in small plants where there are only a few workers. We want the ratings to be based on the 
same standard in all the plants* 

3. A suggested method is to rate all workers on one question at a time. The questions ask about 
different abilities of the workers. A worker may be good in one ability and poor in another; 
for example, a very slow worker may be very accurate. So rate all workers on the first question, 
then rate all workers on the second question^ and so on. 

4. Practice and experience usually improve a worker's skill. However, one worker with six 
months' experience may be a faster worker than another with six years' experience. Don't 
rate one worker as poorer than another because he has not been on tbe job as long. 

6. Rate the workers according to the work they have done over a pt^riod of several weeks or 
months. Don't rate just on the basis of one "good" day, one "bad"' day or some single 
incident. Think in terms of each worker's usual or typical performance. 

6. Rate only on the abilities listed on the rating sheet. Do not let factorii such as cooperative- 
ness, ability to get along with others, promptness and honesty influence your ratings. Although 
these aspects of a worker are important, they are of no value for this study as a ^'yardstick" 
against which to compare aptitude test scores. 

Please fll in the information requested on the reverse side of this sheeL 

tryi^%. 
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Score, 

f^KTItiO SCALE FOR , 



D, 0. T, Title and Code 



Diroctlor.st Please read th« sheet '*S\i^:gestions to Raters* and then fill in 
the items lls*.(?{J below. In inaklng your ratings > only jwie^ bcoc 
should be checked for each question* 



Name of .forkcr (print) 



(Last) ~ jjTj-jij-^ 

S.X2 rale Ffinale 

Ccap-viy Job Titles 



"crf often do you s^.e this ..orker in c k-n.^k sitiitlon? 
/ J See hia at work all the tiae. 
/ / See hias at work several tiaes a day, 
/ ' / See hia at work several tiiA^s a week* 
Seldom see hire in work situation* 

:{jw long h=iv* you ^» or kid with hiic? 
/ / Tnder o.:e scnth* 

/ One to two months* 

/ Three to five acnths* 
/ / Six months or aore. 
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A. How much nork can he get done? (Worker* s ability to make efficient use of 
his time and to work at high speed.) 

1. Capable of very loir work output. Can perform only at an unsatls^ 
factory pace* 

2. Capable of low work output. Can perform at a alow pace. 

m 3» Capable of fair work output. Can perform at an acceptable but not 
a fast pace. 

CS] f^m Capable of high work output. Can perform at a fast pace. 

I .] 5« Capable of very high work output. Can perform at an unusually fast 
p^co. 

a. How good is the quality of his work? (Worker's ability to do hlgh^rade work 
which meets quality standards.) 

1. Very poor* Does vork of unsatisfactoiy grade. PerforirAnce Is 
inferior and alnost never neets isininuia quality standards. 

/ 7 2. Not too bad, but the grade of his work could stand Improvement. 

PerfoiT.ance is usually acceptable but 8o::.ewhat inferior in quality. 

3. Fair. The grade of his ^tork is mediocre. Performance is acceptable 
but usually not superior In quality. 

4. Good, but the grade of his work is not outstanding. Perfon ince Is 
usually superior in quality. 

5. Very good. Does work of outstanding grade. Performance is almost 
always of the highest quality. 

C. '-!■ * i :- ^ta is he in his vfork? (T'orkar's ability to av'^ld ssaklng mistakes.) 

/J/ 1, Veiy inaccurate. Uakes very many mistakes. Uork needs constant 
checking. 

^37 2. Inaccurate. Hakes frequent mistakes. Work needs more checking than 
ie desirable* 

£J 3. Fairly accurate* Hakes misUkes occasionally. Work needs ooly nonaal 
cheuldng. 

/27 ^* Accurate, llakes few mistakes. Work seldom needs checkittg* 

rn 5* Hi«My accurate. r\ro2y makes a mistake. Tiork almost never needs 
ehecldng. 

24 
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P« Hem much does he know about his job? (Worker's understanding of the prineiples^ 
equipment, materials and methods that have to do directly or indirectly with his 
irork») 

CJU Has ▼ety limited knotvledge* Does not know enough to do his Job 
adequately* 

/ 7 Has little knowledge » Knows enough to *get by** 

/ 7 3* Has itodorate amount of kna»rledge» Knows enough to do fair work* 

/"7 ^» Has bivad knowledge* Knows enough to do good work* 

^/ 5* Has complete knowledge* Knows his job thoroughljr* 

B* Wo t nrach aptitude or facility does he have for this kind of work? (Worker's 
rd-ptness or knack for perfonaing his job easily and well*) 

/*7 1* Vexy low aptitude. Has great difficulty doing his job. Not at all 
suited to this kind of work. 

>ri7 2« ^cn aptitude. Usually has some difficulty doing his job. Not too 
•well suited to this kind of work* 

3» Modeiate aptitude, ^es his job without too much difficulty. 
Fiirly veil suited to this kind of work. 

A# High aptitude* Usually does his job without difficulty. Well 
suited to this kind of work* 

£ZJ 5« Vexy high aptitude. Doss his job ^.ith great ease* Unusually well 
suited for this kind of .v>rk* 

F. How large a ^arJ.-ity of job duties can he perform efficiently? (Worker's 
ability to ^'^ndle sevoial differ-»nt operations In his work.) 

£^ 1* K %ary limited variety. Cannot perform c*ifferent operations 
adequately* 

CZJ 2. A small variety* Can perfom few different operations efficiently* 

/ / 3» A moderate variety* Can perfom some different operations with 
reasonable efficiency* 

^* A large variety* Can perfom several different operaticns efficiently* 

CJ 5» An unusually large variety* Can do very many different ^rations 
efficiently* 

ERIC 
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How resourceful la he when 3o^»thiI^g differ rent comes up or something out of 
the ordinary occurs? CWorker*8 ability to apply what he already knows to a 
new altuatlGsi*) 

/ry X. Very unresourceful. Almost never Is able to figure out what to do. 
Needs help cn even minor problems. 

£y 2. Unresourceful. Often has difficulty handling new situations. Needs 
help cn all but sinple problems. 

£^ 3. Fairly resourceful. Sc.-.etlrios knovfs what to do, sometlines doesn't. 
Can deal with problems that are not too complex. 

iZJ k» Resourceful. Usually able to h-ndle new situations. Needs help or 
only conplex* problems. 

/~y 5, Very resotirceful. Practically al-.:ays f injures out v.hat to do himself. 
Rarely needs help, even on coaplex problers. 

Ha.T often does he make practical suggestions for doing things lii better ways? 
('.•:orker*s ability to ii;.prove work methods.) 

£*7 1. Never, Sticks strictly with the routine. Contributes nothing in the 
vay of practical suggestions. 

/~y 2. Very sol^on. Slow to see new -rrays to ...prove <j^?t:iorfs. Contributes 
few px-actlcal suggestions. 

/*7 3. Once in a while. Neither quick nor sic* to sea nets vays to ioiprove 
^"^^ methods • Contributes some practical suggestions. 

f^J 4, Frequently. Quick to see new ways to improve rcethods. Contributes 
more than his share of practical suggestions. 

/"7 5« Ven* often. Extr^ :?ly ftlert to see new ways to imorove methods. 
Contributes an uimsually large number of practical suggesticr.s. 

Considering all the factors already rated, and ailar these factors, how satis- 
factoiy Is his work? (Worker's •all-around* ability to do his job.) 

£J 1. Definitely unsatisfactory. Would be better off without hl«. Fer- 
formance usually not acceptable. 

£J 2. Not ccwpletely satisfactory. Of limited value to the organisation. 
Perforsascs somewhat inferior. 

£Jf 3. Satisfaotoxy. A fairly proficient worker. Performance generally 
acceptable. 

4. Good. A valuable worker. Perfor/^nce usually superior. 

/37 5. Outstanding. *n unusually competent -orker. Perforaanca almost 
ali'ays top notch. ;ci(> 
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APPENDIX k 

S-523R7U 

Clerk, General Office (clerlcaU 21'^.58S 

JOB DUTIES 

Perforns e v/lde range of clerical duties: 

Maintains files: Sorts, arranges and files alphabetically, numer- 
ically, chronologically or by subject i.iatter; locates and removes 
material from f\\^ upon request; prepares necessary chargeout 
records. 

♦Uses a typewriter to perform various duties: Types letters 
and reports, fills in fortes and cuts stencils from longhand 
or typev.T i tten cony; types names and addresses on envelopes, 
cards and labels; checks v/ork for errors. 

♦Prepares and checks reports, bills, statements and invoices 
from original orders, sales charge slips or other records: Uses 
adding machine to add and subtract figures; operates a cal- 
culating (tachine to add, subtract, multiply and divide; writes 
coppute*^' answer on records or reports; enters customer s name, 
address, account and/or order number, items, prices, discounts 
and totals on printed form. May calculate figures on oay records, 
••'.ay insert bills in envelopes. Checks work for errors. 

Porforr's ..u seel 1 aneo' s clerical duties: iiay take notes or Make 
verbatir. records and transcribe arterial in prescribed form using 
a typewriter. Gives information requested by persons calling or 
coning Into office. Keeps a continuous record of supplies and/or 
equipnent received or Issued; lists items to be ordered; i.iay niake 
periodic physical counts of stock. Opens nail, stamps time r i- 
celved on lall, reads and sort? incoming nail, and delivers nail 
to proper person or department. 



♦These job duties are designated as critical job dut'ies since they 
:.iust be perfor-'ied competently if the job Is to be performed in a 
satisfactory nanner. General Office Clerks spend about 7S% of 
their workinji tine performing these duties. 
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